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Abstract: This article provides a representation theorem for a set of Gaus- 
sian processes; this theorem allows to build Gaussian processes with arbi- 
trary regularity and to write them as limit of random trigonometric series. 
We show via Karlmnen-Love theorem that this set is isometrically equiv- 
alent to l"^ . We then prove that regularity of trajectory path of anyone 
of such processes can be detected just by looking at decrease rate of 
sequence associated to him via isometry. 
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1. Introduction 

The aim of this article is to provide a simple and general method for constructing 
continuous and periodic Gaussian processes of arbitrary regularity. Periodic real 
processes arise as natural tool in analyzing continuous processes on the circle 
(e.g., in image analysis, when processing noises of closed lines). More recently, 
they found a great development in the theory of Random Fields on the sphere 
(see [8] and the reference therein). 

The Brownian Bridge Bt is a well known example of a continuous and periodic 
Gaussian process on [0, 1]. Although it is not stationary, it becomes stationary 
if we remove the path- integral Jq Bgds, see [4]. If we model a noise with such a 
process, its supremum may be used to test the null hypothesis. Moreover, this 
supremum is the limiting distribution of an optimal test statistic for the unifor- 
mity of the distribution on a circle, [4]; in Section 2.1, we show that this process 
is strongly related to one generated by Bt by randomly choosing the starting 
point on [0,1]. To generalize this example, we propose an approach which is 
linked to Karhunen-Loeve's expansion that gives uncorrelated coefficient. This 
expansion is optimal in regression functional studies, as shown in [3]. In fact, 
periodic processes are easily decomposed with Fourier basis, and stationarity 
will cause the coefficients of the sin and cos of the same frequency to be equal. 
Thus, we underline a natural isometry between this representation of Gaussian 
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processes and l'^ . The asymptotic decay of the Karhunen-Loeve's coefficients will 
be related to the regularity of the paths, as a consequence of Fourier analysis. 
Thus, it will be possible to define a "periodic fractional Brownian motion" by 
choosing an appropriate asymptotic decay (see also [1, 5]) of the coefficients. 

For what concerns notations, s, . . . relates to time variables, and will often 
belong to [0, 1]. We denote by {xt}t<^[Q.i\i {vt}t£[G,i], ■ ■ ■ stochastic adapted pro- 
cess defined on a given ffitered space {-7^t}tg[o,i],IP), while (X„)„, iYn)m {Zn) 
are sequences of random variables. C(s, t) is a positive semidefinite function (it 
will be the correlation function of a stochastic process). When a process is sta- 
tionary, its covariance function will often be replaced by the associated covari- 
ogram function C{t). The sequence (e/c(t))fcgN denotes a sequence of orthogonal 
function on L^([0,1]). Finally, we denote by \t\i the fractional part sawtooth 
function of the real number i, which is deffired by the formula \t\i — t — floor(i). 



2. A canonical form for Gaussian periodical processes 

The first example of signal theory usage in the description of stochastic pro- 
cesses can be found in [6], where is exposed a theorem that allows to represent 
Gaussian processes as limits of stochastic Fourier series. The classical statement 
of Karhunen-Love's theorem is the following, as described in [2]. 

Theorem 2.1 (Karhunen-Love). Let {xt}t£[a.b]j a,b < oo , such that E[xt] = 0, 
yt € [a,b], and C'ov{xt,Xs) = C{t,s), continuous in both variables. Then 



^Zfcefc(i), a<t<b, 



k=l 



where are the eigenfunction of following integral operator from L'^[a,b] in 
itself 

f e L^[a, b] ^ g{t) = I C{t, T)f{T)dT, a<t<b, 



and Ck form an orthonormal bases for the space spanned by eigenf unctions cor- 
responding to nonzero eigenvalues. The Zk are given by 

b 

xtek(t)dt 

and are orthogonal random variables (E(ZkZj) = for k ^ j), with zero mean 
and variance A|, where is the eigenvalue corresponding to e^. The series 
SfcLi ZkCkit) converges in mean square to Xt, uniformly in t, that is 



oo 

E{{xt-y^Zuek{t)f) 



k=l 



uniformly for t g [a, 6]. Moreover if Xt is Gaussian, the Z^ in expansion are real 
independent Gaussian random variables. 
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In this paper we provide a result that allows to build Gaussian proeesses of 
arbitrary regularity, proceeding on the way tracked by Adler (see [1]). The result 
will be based on Karhunen-Love's decomposition theorem, and will deal with 
following set of processes. 

Definition 2.1. is the set of real Gaussian stochastic processes {xt}t£[o,i\ 
such that they are continuously stationary (so if C(s, t) is the covariance function 
then there exist a real continuous function C{s~t) = C(s, t) Vs, t, R), periodical 
(i.e. xq = xi,a.s.) with E{xt) = 0, £ R. 

The set is a Banach space, when it is equipped with the inner product 
given by 

({a;t}t6[o,i]'{yt}ie[o,i]) = / E{xtyt)dt eR+. 

Ja 

Remark. We remark that if {xt}telo,i] S and if C{s — t) — C{s,t) is its 
covariogram function, then C{to) = C{to + 1). 

We are going to specialize Karhunen-Love's decomposition theorem to , 
showing that a process is in Jif if and only if it can be written as limit of a canon- 
ical trigonometric random series. From this result we will show that Jif may be 
seen as a Hilbert space, isometrically equivalent to the space of the coefficients 
i'^; via this isometry it will be easy to create Gaussian stationary processes with 
arbitrary regularity, by looking at decreasing speed rate of canonical series coef- 
ficients. Moreover, this result allows also to detect information about regularity 
of a process, since it relates it with the regularity of its covariogram function. 

Theorem 2.2. Let {xt}te[o^i] G with covariance C{s,t) = C{t— s); then in 
mean square, uniformly in t, 

oo 

xt = cqY^ + CkiYkV2sin{2kTrt) + YlV2 cos{2kTit)) 

k=l 

where (!'„)„, iY^)n are two independent sequence of independent standard Gaus- 
sian variables, and {ck)k € £^ is such that 

= / C{s)cos{2n'Ks)ds, n = 0,1,2,... 

Proof. By Mercer Theorem (see, e.g., [2]) we know that if (e„)„ is an orthonor- 
mal bases for the space spanned by the eigenfunctions corresponding to nonzero 
eigenvalues of integral operator 

x e L'^[0,1] ^ y{t) ^ [ C{t,T)x{T)dT, a<t<b, 
Jo 

then, uniformly, absolutely and in L^[0,1] x [0,1], C{s,t) = ^2^=0 ^k{t)ek{s)Xk 
, where Xk is the eigenvalue corresponding to Ck- By Remark 2 we are going to 
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see that (cos(2n7rs), siii(2n7rs))„ are eigcnfunctions relative to operator whose 
kernel is C{s,t). In fact, let a„ ~ C{s) cos{2'mTs)ds, then 

cos{2mTt)C{t — T)dt = a„ cos(2n7rr), 

the same relation holding when cos is replaced by sin. It follows from Mercer 
Theorem that 

oo 

C(s, t) = oq + 2afc cos(2fc7r(s — t)) 
fe=i 

uniformly, absolutely and in L^[0, 1] x [0, 1] and that (a„)„ £ i^, and hence the 
sequence (c„)„ formed by c„ = A/|a„| lays in From Theorem 2.1 and The- 
orem 2.2 we deduce the existence of two independent sequence of independent 
standard Gaussian variables (Yn)m (^,0" such that in mean square, uniformly 
in t 

oo 

xt = cqY^ + Ck{YkV2sm{2kTrt) + YlV2 cos{2kTrt)) . 
fc=i 

□ 

Theorem 2.3. Let (Yn)n, iY^)n be two independent sequence of independent 
standard Gaussian variables, and {ck)k G Then the sequence 



(") 
Vt = Co 



Yg' + CkiYkV2sm{2knt) + Y/,V2 cos{2kTTt)) 



k=l 



converges in mean square, uniformly in t to {yt\te[o.i] ^ Moreover ifC{s,t) 
is the yt covariance function, then uniformly, absolutely and in L^[0, 1] x [0, 1], 

oo 

C(s, t) = cl + Y 2cfc cos(2fc7r(s - t)). 
fc=i 

Proof. First of all we notice that Gaussian process y^"'' converges to a periodical 
{yt}te[o,i] in mean square uniformly in t, because 

rn 

sup £;[|y(")-yfV]=2 5:4^0. 
te[o,i] i,_„ 

f^—n ra.n 

Let's look at {yt\t£[o.i\ properties: it is a calculation to show that E[yt] = for 
all t, and that 

oo 

Cov{yt,ys) = + 2 ^ 4 cos(2fc7r(s - t)), 

k=l 

which is a continuous function, and that 

oo 

E[y^]^cl + 2j24^mc.r)nr-cl. 

fc=l 
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Moreover {yt}te[o.i] is a Gaussian process, because the two sequences (Yn)n 
and, {Y^)n are Gaussians. 

□ 

Corollary 2.1. Let us consider a couple Z = {{Yn)n,iY'n)n) of independent 
sequence of independent standard Gaussian variables. For each {zt}te[o,i] € 
there exists an {xt}te[Q.i] S -^z having the same law, where 

■y^z = |{a;t}tg[04] € ^ ■ 

oo 

Xt = aoY'o + V2^ afe(Yfe sin(2fc7rt) + Y' k cos{2k7rt)), (a„)„ G 

k=l 

and the limit is in mean square and uniformly in t. 

Geometry of M'z ■ isometry with 
For (a„)„ e define 

oo 

Xt = ao^'o + ""^^^ sin(2fc7rt) + Y'^ cos(2fc7rt)). 

fe=i 

From Theorem 2.2 and Theorem 2.3 it foUows that ||a;t||,^ — -^/cq + 2 a^, 
and hence it is naturally defined an isometry between the representative space 
and e. 



Regularity of the paths 

We have seen that to each stochastic process in J(f can be associated a se- 
quence in i'^. We are now showing how are related the decrease rate of such 
sequence with the regularity of the process trajectory path. We first recall a 
classic regularity theorem. 

Theorem 2.4 (see [10]). Let {xt}t^[o^i] a real stochastic process such that there 
exist three positive constants 7, c and e so that 




so there exists a modification {it}t(E[o.i] of {xt}t£[o^i], such that 

for all a £ [0, in particular the trajectories of {xt}t^[o,i] are Holder contin- 
uous of order a. 
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It is simple to apply this last theorem to processes staying in . It is well 
known that if F w N{{),a^), then = g-p ^^rj^j-) ^ ^^^^^ ^^^^^ ^^^^ 

this fact we deduce the following result. 

Theorem 2.5. Assume that {xt}te[o.i\ G ^ ^"^^ C!{s,t) = C(s — 6e 
ifa covariance function. If C is Holder continuous of order a, then almost all 
trajectories of {xt}te[Q^i] are Holder continuous of order /? < ^. 

Proof. Since 

E{\xt+h - xt\^) = E[x1 + x1^^ - 2xt+nxt) = 2((7(0) - C{h)) < M\h\'', 

we deduce that 

E{\xt+,, ~ xtf^) = 2?'Cp(C'(0) - C{h)Y < M\hr 

so, by Theorem 2.4, if pa = 1 + e, for all p > ^, almost all trajectories of 
{xt}te[o,i] ^re Holder continuous of order /3, with /3 < ^'^^^ ; but this is true for 
eachp > ^, we conclude that almost all trajectory path of {xt}te[o,i] ^-I'c Holder 
continuous of order /3 < ^ ■ CH 

A very useful result for our analysis will be the following one, whose proof 
may be found in [7]. 

Theorem 2.6 (Boas' Theorem). Let f G i^[0,l] be a function whose Fourier 
expansion has only nonnegative cosine terms, and let (a„)„ be the sequence of 
its cosine coefficient. Then 



fis Holder continuous of order a au = O 




Boas' Theorem may be used in connection with Theorem 2.2 and Theorem 2.3 
to deduce more regularity properties of the processes in . In fact, take (c„)„ 
as in Theorem 2.2 and Theorem 2.3. From Boas' Theorem we have that if 
k^c\ = 0[jxT^) for < a < 1, then ff^C is Holder continuous of order a. This 
link between the regularity of C and the paths of {xt\te[o,i] is underlined in the 
following theorem. 

Theorem 2.7. With the notations of Theorem 2.3, if c| = O(-p^), then 
almost all trajectories o/ {2;t}tG[o,i] '^'^e Lipshitz continuous, and, as function of 
t, {xt}te[o 1] have a continuous derivative {x^}ti^[o i] Holder continuous of order 
/3<f. 

Proof. It is clear that 



oo oo 

d^C{5) = 29^ d cos(2/c7r((5)) = -2 ^ {^Trfk'^cl cos{2kn{dj) 

k=l k=l 
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and that d^C is Holder continuous of order a, for some < a < 1. Moreover 
we have that uniformly in t and in mean square 

oo 

xt cqFo + \/2 ^ Cfc(Yfc sin(2fc7rt) + cos(2fc7ri)). 

k=l 

and, from Theorem 2.2, there also exist a stochastic process in such that 
uniformly in t and in mean square 

oo 

it ^ 2\/27r^fccfc(rfcCos(2fc7ri) - F^' sin(2fc7rt)), 
fe=i 

which has covariogram function Holder continuous of order a given by 

oo 

C{6) = 2 ^ (27r)2fc24 cos(2fc7r(5)). 



fe=i 



If we define 



(n) 

yi 



coVo' + \/2 ^ Cfc(Yfe sin(2fc7rt) + cos(2fc7rt)) 



fc=i 



2y27r^/scfe(YfeCOs(2fc7rt) - F^! sin(2fc7rt)), 
fc=i 

than yj"'' = + J* yi^^dr, a.s. for any n, while for each fixed t, in mean square 
we have /J yr^^'dr — > /J St- dr. Since 



it follows that a.s. = xq + /q Xrdr. By Theorem 2.5 we know that almost 
all trajectory path of it are Holder continuous of order /3 < and thesis 
follows. □ 

A natural generalization of this result is the following: 

Corollary 2.2. //, in previous notation, cf, = 0{ ^.i+iLi+a ) then almost all tra- 
jectory path o/ {(?'^a;t}tg[g , with k < m, are Lipschitz continuous, and admit, 
as function oft, a continuous derivative {9™a;t}jg[o,i] Holder continuous of or- 
der P, for all 13 < ^. 
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2.1. The centered Brownian bridge 

Take a Brownian bridge {xt}t^[o,i]- This process is Gaussian, periodic but not 
stationary, since xq — Xi = 0. If we randomize the starting point of the process, 
by shifting the i-axis of a [0, l]-uniform random variable U, we obtain the process 

xt=xit-uu (2-1) 

which is expected to belong to Jf. A process with the law of {xt}te[o.i] called 
centered Brownian bridge. Let us recall that a Brownian bridge may also be 
represented as 

r--^ sin( knt) 
fe=i 

One may expect that the periodic process 

y^ = aYo + \/2 V — (Yfe sin(2fc7ri) + Yl cos(2knt)) , 

k=l 

which shares the same asymptotic behavior of the coefficients of {a^t}te[o,i] is 
closely related to {xt}t£[o,i] - The next theorem shows this facts. 

Theorem 2.8. A centered Brownian bridge {a;t}tg[o.i] given in (2.1) belongs to 
Jif, with covariogram function C{S) ^''^"l'^^^^^' + jz- ^ 

may be represented as 

1 °° 1 

xt = —F=yL + V2 V -T^T-^k sin(2fc7rt) + Yi cos{2kTTt)). 
V12 ^ 2fc7r 

^ k=l 



Proof. By conditioning on U, it is simple to prove that E{xt) = and E{xsXt) 

24 



^* "^2^^^'' — I- ^ = C{\t — s\). A straightforward calculation gives 

"1 1 /•! 



1 f - 1 

777' 4=/ C(s) cos(2n7rs)(is = — — r2,n>l, 

and hence the Karhunen-Lovc theorem gives 

Xt = -^Y^ + y ^{YkV2sni{2k'Kt) + rfc'^/2 cos(2/c7rt)). 
V12 ^ 2fc7r 
^ fe=i 

What remains to prove is that all the (Y'fe,Y^)s are Gaussian. To sketch the 
proof for Yfe (the same arguments apply to Y"^), we first recall that, conditioned 
on [/ = s, 

Zfe = /' xtV2s\n{2k^t)dt ^ t V2y ^ /M^^l^-^li) ^gi^(2fc^^)^^ 

27r/e Jo Jo ±^1 



n=l 

oo 



W^2fe^2sm(2fc^ ^ (_!)»_ 1 

cos(2fc,r.)— + E ^" 
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Therefore, the characteristic function $s.Zfc {t) of Zk conditioned on U ~ s is 



and hence the characteristic function (t) of Zk is 
Jo 

Now, since 

7r4 ^ Wfc2-n2/ A:27r4 ^ V2fc + 2m + l 2/e-2m-l 



4fc27r2 



1 

we get (i) = e = ^ which concludes the proof. □ 

The word "centered" in the definition of {it}tG[o,i] is clearly related to the 
randomization of the starting point of the underlying Brownian bridge. 

In fact, we can say more: {£t}(g[o.i] is strongly related to the y-centralization 
of the Brownian bridge, i.e. to the following process 

xt = xt~ I xt dt, (2.2) 
Jo 

where {xt}t£[o,i] is a Brownian bridge. This last process stays in J^, and his 
sup is the limiting distribution of an optimal test statistic for the uniformity of 
the distribution on a circle, see [11, 4]. 

Corollary 2.3. If {xt}te[o,i] is a centered Brownian Bridge, then it holds 

Xt ^ xt + Z 

where Z is an independent random variable with null expectation and variance 
j^, and {xt}t<£[o,i] is defined as in (2.2). Furthermore 

oo ^ 

Xt = V2 ^ sm{2kTTt) + Yfe' cos(2fc7ri)). (2.3) 

fe=i 

Proof. The covariogram function of {xt}te[o,i] ^(^) = ^l'^l~^^/2) ^ ^ggg 

[4] ) . It is sufficient to calculate the covariance function of it + Z and to use the 
Corollary 2.1 to complete the proof. □ 

2.2. A computational parametric model for smoothing 

Results provided in this paper allows to create a Gaussian parametric family of 
stationary and periodic processes of arbitrary regularity. In fact, let us consider 
the following family of processes in J^f that extends (2.3) 

oo 

Xt = y2 ■r-(^fcsin(2fc7rt) + cos(2fc7rt)). (2.4) 

k=l 
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p=2.1 p=3.1 




0.5 1 0.5 1 



Fig 1 . A comparison between trajectories of process xt referred to same event and varying 
the value of p in {1, 1.6, 2.1, 3.1} 



Theorem 2.5 states that the paths become more regular as p increases. This 
property is shown in Figure 1, which suggests how to smooth a process by 
changing p. 

Summing up, model (2.4) gives a family of Gaussian processes whose trajec- 
tories are arbitrarily regular. In application, maximum likelihood estimates of 
a and p is a straightforward consequence of a FFT of the observed discretized 
process {xt}te[o,i]- 
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